Joint upsampling and noise reduction for real-time depth map enhancement
نویسندگان
چکیده
An efficient system that upsamples depth map captured by Microsoft Kinect while jointly reducing the effect of noise is presented. The upsampling is carried by detecting and exploiting the piecewise locally planar structures of the downsampled depth map, based on corresponding high-resolution RGB image. The amount of noise is reduced by accumulating the downsampled data simultaneously. By benefiting from massively parallel computing capability of modern commodity GPUs, the system is able to maintain high frame rate. Our system is observed to produce the upsampled depth map that is very close to the original depth map both visually and mathematically.
منابع مشابه
Plane Fitting and Depth Variance Based Upsampling for Noisy Depth Map from 3D-ToF Cameras in Real-time
Recent advances of ToF depth sensor devices enables us to easily retrieve scene depth data with high frame rates. However, the resolution of the depth map captured from these devices is much lower than that of color images and the depth data suffers from the optical noise effects. In this paper, we propose an efficient algorithm that upsamples depth map captured by ToF depth cameras and reduces...
متن کاملA Noise-Aware Filter for Real-Time Depth Upsampling
A new generation of active 3D range sensors, such as time-of-flight cameras, enables recording of full-frame depth maps at video frame rate. Unfortunately, the captured data are typically starkly contaminated by noise and the sensors feature only a rather limited image resolution. We therefore present a pipeline to enhance the quality and increase the spatial resolution of range data in real-ti...
متن کاملRobust High Quality Image Guided Depth Upsampling
Time-of-Flight (ToF) depth sensing camera is able to obtain depth maps at a high frame rate. However, its low resolution and sensitivity to the noise are always a concern. A popular solution is upsampling the obtained noisy low resolution depth map with the guidance of the companion high resolution color image. However, due to the constrains in the existing upsampling models, the high resolutio...
متن کاملFast Depth Map Upsampling using Edge Information
In this paper, we propose a new depth map upsampling method to increase the depth image resolution using edge information. Although the joint bilateral upsampling (JBU) method expands the resolution of the depth map using two weighting functions, the complexity of JBU is relatively high. In the proposed upsampling method, we reduce the complexity of depth map upsmapling operation using a color ...
متن کاملMulti-step joint bilateral depth upsampling
Depth maps are used in many applications, e.g. 3D television, stereo matching, segmentation, etc. Often, depth maps are available at a lower resolution compared to the corresponding image data. For these applications, depth maps must be upsampled to the image resolution. Recently, joint bilateral filters are proposed to upsample depth maps in a single step. In this solution, a high-resolution o...
متن کامل